Context aware selective backlighting techniques

ABSTRACT

Context aware backlighting techniques include determining a focal point of a display space based on a user display context. The user display context represents an area of interest on the monitor. The user display context can be based on eye tracking data, ambient light data, motion sensing data, cursor location in the display space, an image content, proximity data, or the like and any combination thereof. A first set of one or more of a plurality of backlight sections corresponding to the determined focal point of the display space can be driven to output at a first intensity level, while a second set of one or more of the plurality of backlight sections can be driven to output at a second intensity level.

BACKGROUND

Liquid crystal display (LCD) based televisions, computer monitors, smartphone screens and similar devices have become very common. An LCDmonitor uses a plurality of liquid crystal elements and color filtersarranged in an array of display pixels. The LCD elements and filters donot produce light by themselves. Instead, a backlight produces the lightused for displaying images. Each LCD element selectively transmits orblocks light depending upon the state of the respective LCD element. Thefilter allows a particular color of light (e.g. wavelength of light) topass when the corresponding LCD element is in a light transmittingstate. The pixels are generally arranged in groups of red, green andblue pixels, or similar color space organizations. Typically, a highpercentage of the power required by a device is used by the backlight ofits LCD display. Power utilization in electronic devices, particularlydevices that are powered by a battery, is almost always a concern andongoing efforts are made to reduce power consumption.

BRIEF DESCRIPTION OF THE DRAWINGS

Features and advantages of the disclosure will be apparent from thedetailed description which follows, taken in conjunction with theaccompanying drawings, which together illustrate, by way of example,features of the disclosure; and, wherein:

FIG. 1 is a block diagram of a computing platform in accordance with anexample embodiment;

FIG. 2 is a block diagram of a backlight controller in accordance withan example embodiment;

FIG. 3 is a flow diagram of a backlighting method in accordance with anexample embodiment; and

FIG. 4 is a block diagram of a computing platform in accordance withanother example embodiment.

DETAILED DESCRIPTION

Before invention embodiments are described, it is to be understood thatthis disclosure is not limited to the particular structures, processsteps, or materials disclosed herein, but is extended to equivalentsthereof as would be recognized by those ordinarily skilled in therelevant arts. It should also be understood that terminology employedherein is used for describing particular examples or embodiments onlyand is not intended to be limiting. The same reference numerals indifferent drawings represent the same element. Numbers provided in flowcharts and processes are provided for clarity in illustrating steps andoperations and do not necessarily indicate a particular order orsequence.

Furthermore, the described features, structures, or characteristics canbe combined in any suitable manner in one or more embodiments. In thefollowing description, numerous specific details are provided, such asexamples of layouts, distances, network examples, etc., to convey athorough understanding of various invention embodiments. One skilled inthe relevant art will recognize, however, that such detailed embodimentsdo not limit the overall inventive concepts articulated herein, but aremerely representative thereof.

As used in this written description, the singular forms “a,” “an” and“the” include express support for plural referents unless the contextclearly dictates otherwise. Thus, for example, reference to “an engine”includes a plurality of such engines.

Reference throughout this specification to “an example” means that aparticular feature, structure, or characteristic described in connectionwith the example is included in at least one invention embodiment. Thus,appearances of the phrases “in an example” or “in an embodiment” invarious places throughout this specification are not necessarily allreferring to the same embodiment.

As used herein, a plurality of items, structural elements, compositionalelements, and/or materials can be presented in a common list forconvenience. However, these lists should be construed as though eachmember of the list is individually identified as a separate and uniquemember. Thus, no individual member of such list should be construed as ade facto equivalent of any other member of the same list solely based ontheir presentation in a common group without indications to thecontrary. In addition, various invention embodiments and examples can bereferred to herein along with alternatives for the various componentsthereof. It is understood that such embodiments, examples, andalternatives are not to be construed as de facto equivalents of oneanother, but are to be considered as separate and autonomousrepresentations under the present disclosure.

Furthermore, the described features, structures, or characteristics canbe combined in any suitable manner in one or more embodiments. In thefollowing description, numerous specific details are provided, such asexamples of layouts, distances, network examples, etc., to provide athorough understanding of invention embodiments. One skilled in therelevant art will recognize, however, that the technology can bepracticed without one or more of the specific details, or with othermethods, components, layouts, etc. In other instances, well-knownstructures, materials, or operations may not be shown or described indetail to avoid obscuring aspects of the disclosure.

In this disclosure, “comprises,” “comprising,” “containing” and “having”and the like can have the meaning ascribed to them in U.S. Patent lawand can mean “includes,” “including,” and the like, and are generallyinterpreted to be open ended terms. The terms “consisting of” or“consists of” are closed terms, and include only the components,structures, steps, or the like specifically listed in conjunction withsuch terms, as well as that which is in accordance with U.S. Patent law.“Consisting essentially of” or “consists essentially of” have themeaning generally ascribed to them by U.S. Patent law. In particular,such terms are generally closed terms, with the exception of allowinginclusion of additional items, materials, components, steps, orelements, that do not materially affect the basic and novelcharacteristics or function of the item(s) used in connection therewith.For example, trace elements present in a composition, but not affectingthe composition's nature or characteristics would be permissible ifpresent under the “consisting essentially of” language, even though notexpressly recited in a list of items following such terminology. Whenusing an open-ended term in this written description, like “comprising”or “including,” it is understood that direct support should be affordedalso to “consisting essentially of” language as well as “consisting of”language as if stated explicitly and vice versa.

The terms “first,” “second,” “third,” “fourth,” and the like in thedescription and in the claims, if any, are used for distinguishingbetween similar elements and not necessarily for describing a particularsequential or chronological order. It is to be understood that any termsso used are interchangeable under appropriate circumstances such thatthe embodiments described herein are, for example, capable of operationin sequences other than those illustrated or otherwise described herein.Similarly, if a method is described herein as comprising a series ofsteps, the order of such steps as presented herein is not necessarilythe only order in which such steps may be performed, and certain of thestated steps may possibly be omitted and/or certain other steps notdescribed herein may possibly be added to the method.

As used herein, comparative terms such as “increased,” “decreased,”“better,” “worse,” “higher,” “lower,” “enhanced,” and the like refer toa property of a device, component, or activity that is measurablydifferent from other devices, components, or activities in a surroundingor adjacent area, in a single device or in multiple comparable devices,in a group or class, in multiple groups or classes, or as compared tothe known state of the art. For example, a data region that has an“increased” risk of corruption can refer to a region of a memory device,which is more likely to have write errors to it than other regions inthe same memory device. A number of factors can cause such increasedrisk, including location, fabrication process, number of program pulsesapplied to the region, etc.

As used herein, the term “substantially” refers to the complete ornearly complete extent or degree of an action, characteristic, property,state, structure, item, or result. For example, an object that is“substantially” enclosed would mean that the object is either completelyenclosed or nearly completely enclosed. The exact allowable degree ofdeviation from absolute completeness may in some cases, depend on thespecific context. However, generally speaking, the nearness ofcompletion will be so as to have the same overall result as if absoluteand total completion were obtained. The use of “substantially” isequally applicable when used in a negative connotation to refer to thecomplete or near complete lack of an action, characteristic, property,state, structure, item, or result. For example, a composition that is“substantially free of” particles would either completely lackparticles, or so nearly completely lack particles that the effect wouldbe the same as if it completely lacked particles. In other words, acomposition that is “substantially free of” an ingredient or element maystill actually contain such item as long as there is no measurableeffect thereof.

As used herein, the term “about” is used to provide flexibility to anumerical range endpoint by providing that a given value may be “alittle above” or “a little below” the endpoint. However, it is to beunderstood that even when the term “about” is used in the presentspecification in connection with a specific numerical value, thatsupport for the exact numerical value recited apart from the “about”terminology is also provided.

Numerical amounts and data may be expressed or presented herein in arange format. It is to be understood, that such a range format is usedmerely for convenience and brevity, and thus should be interpretedflexibly to include not only the numerical values explicitly recited asthe limits of the range, but also to include all the individualnumerical values or sub-ranges encompassed within that range as if eachnumerical value and sub-range is explicitly recited. As an illustration,a numerical range of “about 1 to about 5” should be interpreted toinclude not only the explicitly recited values of about 1 to about 5,but also include individual values and sub-ranges within the indicatedrange. Thus, included in this numerical range are individual values suchas 2, 3, and 4 and sub-ranges such as from 1-3, from 2-4, and from 3-5,etc., as well as 1, 1.5, 2, 2.3, 3, 3.8, 4, 4.6, 5, and 5.1individually.

This same principle applies to ranges reciting only one numerical valueas a minimum or a maximum. Furthermore, such an interpretation shouldapply regardless of the breadth of the range or the characteristicsbeing described.

As used herein, the term “circuitry” can refer to, be part of, orinclude an Application Specific Integrated Circuit (ASIC), an electroniccircuit, a processor) shared, dedicated, or group), and/or memory(shared, dedicated, or group) that execute one or more software orfirmware programs, a combinational logic circuit, and/or other suitablehardware components that provide the described functionality. In someaspects, the circuitry can be implemented in, or functions associatedwith the circuitry can be implemented by, one or more software orfirmware modules. In some aspects, circuitry can include logic, at leastpartially operable in hardware.

Various techniques, or certain aspects or portions thereof, may take theform of program code (i.e., instructions) embodied in tangible media,such as floppy diskettes, compact disc-read-only memory (CD-ROMs), harddrives, transitory or non-transitory computer readable storage medium,or any other machine-readable storage medium wherein, when the programcode is loaded into and executed by a machine, such as a computer, themachine becomes an apparatus for practicing the various techniques.Circuitry can include hardware, firmware, program code, executable code,computer instructions, and/or software. A non-transitory computerreadable storage medium can be a computer readable storage medium thatdoes not include signal. In the case of program code execution onprogrammable computers, the computing device may include a processor, astorage medium readable by the processor (including volatile andnon-volatile memory and/or storage elements), at least one input device,and at least one output device. The volatile and non-volatile memoryand/or storage elements may be a random-access memory (RAM), erasableprogrammable read only memory (EPROM), flash drive, optical drive,magnetic hard drive, solid state drive, or other medium for storingelectronic data. The node and wireless device may also include atransceiver module (i.e., transceiver), a counter module (i.e.,counter), a processing module (i.e., processor), and/or a clock module(i.e., clock) or timer module (i.e., timer). One or more programs thatmay implement or utilize the various techniques described herein may usean application programming interface (API), reusable controls, and thelike. Such programs may be implemented in a high level procedural orobject oriented programming language to communicate with a computersystem. However, the program(s) may be implemented in assembly ormachine language, if desired. In any case, the language may be acompiled or interpreted language, and combined with hardwareimplementations.

As used herein, the term “processor” can include general purposeprocessors, specialized processors such as central processing units(CPUs), graphics processing units (GPUs), digital signal processors(DSPs), microcontrollers (MCUs), embedded controller (ECs), fieldprogrammable gate arrays (FPGAs), or other types of specializedprocessors, as well as base band processors used in transceivers tosend, receive, and process wireless communications.

It should be understood that many of the functional units described inthis specification may have been labeled as modules, in order to moreparticularly emphasize their implementation independence. For example, amodule may be implemented as a hardware circuit comprising customvery-large-scale integration (VLSI) circuits or gate arrays,off-the-shelf semiconductors such as logic chips, transistors, or otherdiscrete components. A module may also be implemented in programmablehardware devices such as field programmable gate arrays, programmablearray logic, programmable logic devices or the like.

Modules may also be implemented in software for execution by varioustypes of processors. An identified module of executable code may, forinstance, comprise one or more physical or logical blocks of computerinstructions, which may, for instance, be organized as an object,procedure, or function. Nevertheless, the executables of an identifiedmodule may not be physically located together, but may comprisedisparate instructions stored in different locations which, when joinedlogically together, comprise the module and achieve the stated purposefor the module.

Indeed, a module of executable code may be a single instruction, or manyinstructions, and may even be distributed over several different codesegments, among different programs, and across several memory devices.Similarly, operational data may be identified and illustrated hereinwithin modules, and may be embodied in any suitable form and organizedwithin any suitable type of data structure. The operational data may becollected as a single data set, or may be distributed over differentlocations including over different storage devices, and may exist, atleast partially, merely as electronic signals on a system or network.The modules may be passive or active, including agents operable toperform desired functions.

It is to be appreciated that various standalone devices and subsystem ofdevices used to output images are commonly referred to as displays,monitors, screens, and the like. However, for ease of explainingembodiments of the present invention, such devices and subsystems willbe referred to herein as “monitors”. Some common monitors, such as LCDscreens and televisions, include one or more light generating elementsand a plurality of elements that selectively control the output of lightfrom the light generating elements to output images. For ease ofexplaining embodiments of the present invention, the light generatingelements will be referred to herein as a “backlight,” and the pluralityof elements that selectively control the output of light will bereferred to herein as a “display”.

Example Embodiments

An initial overview of technology embodiments is provided below and thenspecific technology embodiments are described in further detail later.This initial summary is intended to aid readers in understanding thetechnology more quickly but is not intended to identify key features oressential features of the technology nor is it intended to limit thescope of the claimed subject matter.

In one aspect, context aware backlighting can be provided by a backlightcontroller. The backlight controller can include a sensor inputinterface, a focal point module and a backlight driver interface. Thesensor interface can receive a user display context and/or associateddata. The focal point module can determine a focal point of a displayspace based on the user display context. The user display contextrepresents an area of interest on the monitor. The user display contextcan be based on eye tracking data, ambient light data, motion sensingdata, cursor location in the display space, an image content, proximitydata, or the like and any combination thereof. The backlight driverinterface can encode a backlight control signal wherein a first set ofone or more of the plurality of backlight sections, corresponding to thefocal point of the display space, output at a different light intensitythan a second set of one or more of the plurality of backlight sections.Additional operating parameters and/or operating modes of the backlightcan also be controlled based on the user display context.

FIG. 1 depicts an exemplary computing platform in which embodiments ofthe present technology can be implemented. In one aspect, the computingplatform 100 can include a computing device 110 and one or moreinput/output devices. One or more of the input/output devices can be amonitor including a display 120 and backlight 130. The backlight 130 canbe disposed proximate a first side of the display 120. The display 120can selectively transmit light generated by the backlight 130 to produceone or more images at a second side of the display 120.

The monitor 120, 130 can be integral to the computing device 110, suchas a smart phone, tablet personal computer (PC), laptop (PC), hand heldgaming device or the like. Alternatively, the monitor 120, 130 can be anexternal peripheral of the computing device 110, such as a monitorcoupled to a desktop (PC), or the like. In other examples, the computingdevice 110 can be integral to the monitor 120, 130, such as atelevision, virtual reality (VR) headset, or the like.

In one aspect, the monitor 120, 130 can for example be a liquid crystaldisplay (LCD) light emitting diode (LED) backlit monitor including anarray of LCD elements and an LED backlight. In one aspect, the LEDbacklight 130 can be an edge-lit white LED (EL-WLED), a white LED(WLED), red-green-blue LED (RGB-LED), or the like backlight subsystem.In one aspect, the backlight 130 can include a plurality of backlightsections that can be selective controlled to emit light at differentlevels of intensities for one or more of the plurality of backlightsections. In one instance, the backlight may include 15 backlightsections that can each be separately controlled to output at varyingintensity levels. In one instance, the backlight may be compliant withone or more embedded display panel (eDP) standards that support panelself-refresh mechanisms by enabling updates to selected regions of avideo frame buffer.

In one aspect, a backlight controller 140 can be associated with themonitor 120, 130. The backlight controller 140 can be configured forcontrolling the operation of the backlight 130. The backlight controller140 can be integral to the monitor 120, 130 or can be implemented in thecomputing device 110.

When a user is reading an e-book, composing or reading emails or chatmessages, looking at a web page, using a word processing application,and the like, the user is typically focused on a particular part of thedisplay screen. At any point in time, the user may not be interested inall parts of the screen. Instead, the user may be focused on the portionof the screen where the text entry point in an application ispositioned. Similarly, the user may be focused on the portion of a touchsensor screen proximate where they are using a finger to navigatecontent. In another example, the user may be interested in a portion ofa webpage, wherein a particular advertisement, menu bar, or the like, islocated. In another example, the user may have two or more applicationsdisplayed in a screen, where one of the applications is actively beingused while the others are not. The user may therefore be focused on theapplication that is actively displaying dynamic content and/or receivinginputs.

In one aspect, the backlight controller 140 can be configured to receiveand/or determine a user display context (UDC) and/or applicable data.The user display context represents an area of interest on the monitor.The user display context can be based on eye tracking data, ambientlight data, motion sensing data, cursor location in the display space,an image content, proximity data, or the like and any combinationthereof.

In one aspect, the backlight controller 140 can include one or moreapplication programming interfaces (APIs) (e.g., software-to-softwareexchange) to receive the user context and/or applicable data from one ormore software routines. As used herein, the term “software routine”includes routines, utilities, applets, operating system, and the like.Alternatively or in addition, the backlight controller 140 can includein one or more application binary interfaces (e.g., hardware-to-softwareor hardware-to-hardware exchange) to receive the user context from oneor more hardware and/or firmware circuits.

In one example, the backlight controller 140 may receive input from aneye tracker sensor such as a camera indicative of where a user islooking. In another example, the backlight controller 140 may receiveinput from a proximity sensor indicative how far away the user is fromthe monitor. In another example, the backlight controller 140 mayreceive input from one or more sensors including an accelerometer, agyroscope, and/or a global position system (GPS) indicative of whetherthe user is in motion. In another example, the backlight controller 140may receive input from an ambient light sensor or camera indicative ofan ambient light level.

In one aspect, the backlight controller 140 can be configured todetermine a focal point of a display space based on the user displaycontext. Based on the user display context, the backlight controller 140can determine that a user is looking at a specific portion of thedisplay 120. The backlight controller 140 may also be able to determinethat the user is looking at the display 120 as a whole. The backlightcontroller 140 may also be able to determine that the user is notlooking at the display 120.

For example, the backlight controller 140 may determine the focal pointof the display based on cursor location data received from a pointingdevice and alphanumeric data received from a keyboard. In anotherexample, the backlight controller 140 may determine the focal point ofthe display based on an indication, received from an eye trackingsensor, of a portion of the display that a user is looking at. In yetanother example, the backlight controller 140 may determine that a useris not looking at the display based on data received from an eyetracking sensor. Alternatively, the backlight controller 140 maydetermine that a user is not looking at the display based on datareceived from an accelerometer indicating movement and an ambient lightsensor indicating changing ambient light levels, which may indicate thatthe user is walking and is probably not focused on the display 120.

In one aspect, the backlight controller 140 can be configured to encodeone or more backlight control signals, so that a first set of one ormore of the plurality of backlight sections, corresponding to a focalpoint of the display space, outputs at a different light intensity thana second set of one or more of the plurality of backlight sections. Thebacklight controller 140 can also be configured to encode one or morebacklight control signals, so that one or more additional sets ofbacklight sections disposed between first and second set output at oneor more intensity levels of the first and second set of backlightsections to provide a more gradual transition in intensity, that will beless perceptible to the user. The additional one or more sets ofbacklight sections outputting at one or more intermediate intensitylevels also allow the user to more easy see other areas of the displayof interest as the user's eyes move about the display. The backlightcontroller 140 can also be configured to encode one or more backlightcontrol signals, wherein a change in intensity between the first andsecond set of backlight sections occurs gradually over a predeterminedtime that will be less perceptible to the user.

The selective backlighting can also be enabled or disabled for one ormore various use cases. For example, the backlight controller 140 canalso be configured to output at different light intensities during apower saving mode. However, during normal runtime mode, the backlightdriver interface can be configured to encode the backlight controlsignal wherein the first set of one or more of the plurality ofbacklight sections, corresponding to the focal point of the displayspace, output at the same light intensity as the second set of one ormore of the plurality of backlight section.

In another example, selective backlighting can be enabled for activitiessuch as e-book reading or web-browsing when a user is likely to befocused on a portion of the monitor corresponding to a subset of theplurality of backlight sections. In another example, selectivebacklighting can be disabled when the user display context or dataassociated therewith indicates that the ambient light levels areregularly changing, indicative of the user walking, riding a bus or thelike, where it would be preferable to adjust all the backlight sectionsrelative to the ambient light so that the monitor is easier to view. Insuch situations, it may be preferable to increase the intensity of allthe backlight sections as the ambient light intensity increases, anddecrease the intensity of all the backlight sections as the ambientlight intensity decreases. In other examples, selective backlight can bedisabled when the user display context or data associated therewithindicates that the eye tracking for the given size of the monitor cannotbe accurately determined, or the user is far enough away from the screensuch that the user focused on the entire display space and not a portionthereof. In one embodiment, selective backlighting can be enabled whenan electronic device is being powered by a battery, or other exhaustiblepower source, and can be disabled when the electronic device is beingpowered by an A/C power outlet, or the like.

In another example, if the user display context indicates that the useris not currently looking at the display, selective backlighting can bedisabled, and all the backlight sections can be controlled to output ata predetermined lower intensity level to conserve power. When the userdisplay context indicates that the user is currently looking at thedisplay, the backlight driver interface can be configured to encode oneor more backlight control signals, with a first set of one or more ofthe plurality of backlight sections that the user is currently focusedon outputting at a higher light intensity than the other backlightsections.

In another example, the backlight driver interface can be configured toencode the backlight control signal with the first set of one or more ofthe plurality of backlight sections, corresponding to the focal point ofthe display space, outputting at a different light intensity than asecond set of one or more of the plurality of backlight sections whenthe proximity data is in a first range. However, when the proximity datais in a second range, the backlight driver interface can be configuredto encode the backlight control signal with all of the backlightsections outputting at the same light intensity. For example, thecomputing platform may be a virtual reality headset employing a smartphone or other computing device having a relatively small form factordisplay. When the smart phone is being used in the VR headset and theproximity of the display to the user is determined to be in a relativelyclose range, the backlight driver interface can control the plurality ofbacklight display sections to output at different light intensitiesbased on the user's focus point on a given portion of the display. Inthis case, the proximity of the display to the eyes of the user isappropriate for use of selective backlight illumination because the eyesof the user are generally focused on a portion of the displaycorresponding to a subset of the plurality of backlight sections.However, when the smart phone is being used at arms-length for calling,messaging, browsing and the like, the backlight driver interface cancontrol the plurality of backlight section to output at the sameintensity. In such case, the eyes of the user are generally focused onthe entire display and consequently all of the plurality of backlightsections.

Selectively controlling the illumination level of portions of thedisplay space can advantageously reduce power consumption by thebacklight and consequently power consumption by the computing device.Selectively controlling the illumination level of portions of thedisplay space can also advantageously improve contrast. Selectivelycontrolling the illumination of portions of the display space can alsoadvantageously improve the user experience. For example, the reducedpower consumption can increase the runtime of mobile computing devicesoperating on battery power, and improve the user experience. Similarly,the increased contrast can improve the visibility of the display, andimprove the user experience.

FIG. 2 shows schematic of a backlight controller in accordance with anexample embodiment. The backlight controller 140 can include a sensorinput interface 210, a focal point module 220, and a backlight driverinterface 230. In one aspect, the sensor input interface can beconfigured to receive a user display context or data applicable todetermining a user display context 240. The user display contextrepresents an area of interest on the monitor. In one instance, the userdisplay context and/or applicable data may be received from one or moresoftware routines, firmware and/or hardware.

In one aspect, the sensor input interface 210 can be implemented in oneor more application programming interfaces (APIs) (e.g.,software-to-software exchange) to receive the user context and/orapplicable data from one or more software routines. Alternatively, or inaddition, the sensor input interface can be implemented in one or moreapplication binary interfaces (e.g., hardware-to-software orhardware-to-hardware exchange) to receive the user context and/orapplicable data from one or more hardware and/or firmware circuits.

The user display context can be based on eye tracking data, ambientlight data, motion sensing data, cursor location in the display space,image data, proximity data, power source data, or the like and anycombination thereof. If applicable data is received, the data mayinclude eye tracking data, ambient light data, motion sensing data,cursor location in the display space, image data, proximity data, powersource data, or the like and any combination thereof.

In one aspect, the focal point module 220 can be configured to determinea focal point of a display space based on the user display contextand/or associated data. In one instance, the user display content isbased on applicable data processed by other software, firmware and/orhardware outside the backlight controller. In such case, the focal pointmodule 220 can determine the focal point of the display space from thereceived user display context. In another instance, the sensor inputinterface 210 may receive applicable raw data. In such case, the focalpoint module 220 can determine the focal point of the display space fromthe applicable raw data, without the user display context explicitlybeing determined first. Alternatively, the focal point module 220 candetermine the user display content from the applicable raw data 240 andthen determine the focal point of the display space from the determineduser display context.

In one aspect, the backlight driver interface 230 can be configured toencode a backlight control signal 250, wherein a first set of one ormore of the plurality of backlight sections 130 a-n, corresponding tothe focal point of the display space, can be output at a different lightintensity than a second set of one or more of the plurality of backlightsections 130 a-n. The backlight driver interface 230 can also beconfigured to encode one or more backlight control signals, wherein oneor more additional sets of backlight sections disposed between first andsecond set output at one or more intensity levels of the first andsecond set of backlight sections so that a more gradual transition inintensity, that will be less perceptible to the user, is generated. Theadditional one or more sets of backlight sections outputting at one ormore intermediate intensity levels also allows the user to more easilysee other areas of the display of interest as the user's eyes move aboutthe display. The backlight driver interface 230 can also be configuredto encode one or more backlight control signals, wherein a change inintensity between the first and second set of backlight sections occursgradually over a predetermined time that will be less perceptible (e.g.nearly imperceptible, or imperceptible) to the user.

The selective backlighting can also be enabled or disabled for one ormore various use cases. For example, the backlight controller 140 canalso be configured to output at different light intensities during apower saving mode. However, during normal runtime mode, the backlightdriver interface can be configured to encode the backlight controlsignal wherein the first set of one or more of the plurality ofbacklight sections, corresponding to the focal point of the displayspace, output at the same light intensity as the second set of one ormore of the plurality of backlight section.

FIG. 3 illustrates a backlighting method in accordance with an exampleembodiment. In one aspect, a focal point of a display space isdetermined based on a user display context 310.

In one aspect, a first set of one or more of a plurality of backlightsections corresponding to the determined focal point of the display isdriven to output at a first intensity level 320. A second set of one ormore of the plurality of backlight sections are driven at a secondintensity level 330.

In one instance, the first intensity level can be increased above apredetermined intensity level, and the second intensity level is thepredetermined intensity level. In another instance, the first intensitylevel can be a predetermined intensity level, and the second intensitylevel is decrease below the predetermined intensity level.

The selective backlighting can also be enabled or disabled for one ormore various use cases. In one instance, the first set of one or more ofthe plurality of backlight sections corresponding to the determinedfocal point of the display space can be driven to output at the firstintensity level and the second set of one or more of the plurality ofbacklight sections can be driven at the second intensity level during apower save mode. During normal runtime mode, the plurality of backlightsections can be driven at the first intensity level.

FIG. 4 shows a computing platform in accordance with another example.The computing platform 400 can include a computing device 410 and amonitor 420. The computing device 410 and monitor 420 may be implementedas separate devices as illustrated, such as a desktop PC and monitor.Alternatively, the monitor 420 can be integral to the computing device410, such as in a laptop PC, tablet PC, or smartphone. The computingdevice 410 can also be integral to the monitor 420, such as atelevision, virtual reality (VR) headset, or the like.

In one aspect, the monitor 420 includes a backlight and a display. Inone aspect, the monitor 120, 130 can for example be a liquid crystaldisplay (LCD) light emitting diode (LED) backlit monitor including anarray of LCD elements and an LED backlight. In one aspect, the LEDbacklight 130 can be an edge-lit white LED (EL-WLED), a white LED(WLED), red-green-blue LED (RGB-LED), or the like backlight subsystem.The backlight can include a plurality of backlight sections 130 a-n.Each backlight section 130 a-n can be selectively controlled to generatelight with a range of intensity. The range of intensities may besubstantially continuous from a predetermined minimum intensity to apredetermined maximum intensity. Alternatively, the range of intensitiesmay be a plurality of discrete levels between a predetermined minimumintensity to a predetermined maximum intensity. In one implementation,the monitor 420 includes an eDP compliant driver for programmingregional backlight updates.

In one aspect, the computing device 410 includes a computing visionengine 430, a sensor hub 440, a context engine 450 and a graphics enginescheduler 460. In one aspect, the computer vision engine 430 candetermine a portion of the display that the user is focused on.Conventional computer vision engines can accurately track the eye gazeof users to allow the ability to open and control various softwareincluding surfing the Web, making telephone calls, sending e-mails andtext message, creating artwork, playing computer games and the like oncomputing devices. In one example, infrared light sources, such as aninfrared diode can be used to illuminate the eyes of the user. Twocamera sensors, such as low power CMOS camera sensors, can be used tocapture data regarding the reflection of the infrared light off of theretina and the cornea of the user, commonly referred to as “red eye” andglint respectively. Software, firmware and/or hardware, in a centralprocessing unit (CPU, AP), digital signal processor (DSP) or the like,can use the data captured by the camera sensors to build athree-dimensional (3D) model of the user's eyes. The three-dimensional(3D) model of the user's eyes can in turn be used to determine where theuser is looking (gaze point or focal point) and where the user's eyesare in space relative to the location of the camera sensors, computingdevice 410 and/or monitor 420.

In one aspect, the sensor hub 440 can include one or more sensors suchas an ambient light sensor (ALS), one or more accelerometers, one ormore gyroscopes, global position system (GPS) receiver, a magnetometer,and or the like. Although the sensor hub 440 and the computer visionengine 430 are described as separate components, it is to be appreciatedthat the computer vision engine 430 may be combined with the sensors ofthe sensor hub as an integrated sensor hub. Alternatively, the computervision engine 420 and sensor hub 440 may share one or more sensors, suchas the camera sensors to capture both image data and ambient lightintensity level data.

In one aspect, the context engine 450 can be configured to receiveand/or determine a user display context (UDC) and/or applicable data.The user display context represents an area of interest on the monitor.The user display context can be based on eye tracking data, ambientlight data, motion sensing data, cursor location in the display space,an image content, proximity data, power source data, or the like and anycombination thereof.

In one aspect, the context engine 450 can be configured to determine afocal point of a display space based on the user display context. Basedon the user display context, the context engine 450 can determine that auser is looking at a specific portion of the display 420. The contextengine 450 may also be able to determine that the user is looking at thedisplay 420 as a whole. The context engine 450 may also be able todetermine that the user is not looking at the display 420.

In one aspect, the graphics engine schedule 460 can be configured toencode one or more backlight control signals, wherein a first set of oneor more of the plurality of backlight sections, corresponding to thefocal point of the display space, outputs at a different light intensitythan a second set of one or more of the plurality of backlight sections.The graphics engine schedule 460 can also be configured to encode one ormore backlight control signals, wherein one or more additional sets ofbacklight sections disposed between first and second set output at oneor more intensity levels of the first and second set of backlightsections so that a more gradual transition in intensity, that will beless perceptible to the user, is generated. The additional one or moresets of backlight sections outputting at one or more intermediateintensity levels also allow the user to more easily see other areas ofthe display of interest as the user's eyes move about the display (e.g.the user's gaze or focal point moves or changes). The backlightcontroller 140 can also be configured to encode one or more backlightcontrol signals, wherein a change in intensity between the first andsecond set of backlight sections occurs gradually over a predeterminedtime that will be less perceptible, minimally perceptible, orimperceptible to the user.

The selective backlighting can also be enabled or disabled for one ormore various use cases. For example, the graphics engine schedule 460can also be configured to output at different light intensities during apower saving mode. However, during normal runtime mode, the backlightdriver interface can be configured to encode the backlight controlsignal wherein the first set of one or more of the plurality ofbacklight sections, corresponding to the focal point of the displayspace, output at the same light intensity as the second set of one ormore of the plurality of backlight section.

In one implementation, the graphics engine scheduler 460 can be afirmware/hardware based implementation of various imageprocessing/enhancement algorithms.

In one implementation, the camera sensor can be interfaced directly witha DSP, instead of an AP, for real-time access. The DSP can be usedexclusively for eye tracking. The DSP can be used in a low power (LP)implementation, with fixed function blocks, allowing the CPU of thecomputing device 410 to be unused and hence provide LP wakeup inresponse to detection of user focus on the screen. The fixed functionblocks can provide a high level of accuracy and speed for real time eyetracking.

The graphics engine scheduler 460 may be communicatively coupled to thebacklight 130 a-130 n by one or more auxiliary communication (AUX)channels of the computing device 410. In one implementation, the enginescheduler can directly access the AUX channels to communicate with theeDP sink device to program regional backlight updates. The monitor 420can also include a backlight booster chip with fine grains frequencycontrol to provide a smooth gradient to avoid flicker because of quickpulse with modulation (PWM) level changes. The algorithm to smooth outthe backlight changes to give a continuous tracking kind of movement ofbacklight lit regions, matching eye movement, etc., can be implementedin firmware of the graphics engine scheduler.

A typical laptop PC may consume approximately 40 Watts of power while abrowser application is running. Taking into account the typical CPU idletime of computing devices, an average display consumes about 75 percentof system power. Therefore, the backlight may consume almost 30 Watts ofpower. If a backlight includes 15 sections, and dimming sections of thebacklight results in a 5% reduction in power consumption, by selectivelydimming all but one section at which a user is looking, 1.4 Watts ofpower can be saved. A CMOS based eye tracking subsystem currently mayconsume approximately 100-400 milli-Watts. Therefore, at least netsavings of 1 Watt of power will be achieved after factoring in powerconsumed by an eye tracking subsystem.

Again, selectively controlling the illumination level of portions of thedisplay space can advantageously reduce power consumption by thebacklight and consequently power consumption by the computing device.Selectively controlling the illumination level of portions of thedisplay space can also advantageously improve contrast. Selectivelycontrolling the illumination of portions of the display space an alsoadvantageously improve the user experience. For example, the reducedpower consumption can increase the runtime of mobile computing devicesoperating on battery power, thereby improving the user experience.Similarly, the increased contrast can improve the visibility of thedisplay, thereby improving the user experience.

Examples

The following examples pertain to specific technology embodiments andpoint out specific features, elements, or steps that may be used orotherwise combined in achieving such embodiments.

In one example there is provided, a backlight controller comprising: asensor input interface to receive a user display context; a focal pointmodule to determine a focal point of a display space based on the userdisplay context; and a backlight driver interface to encode a backlightcontrol signal wherein a first set of one or more of the plurality ofbacklight sections, corresponding to the focal point of the displayspace, output at a different light intensity than a second set of one ormore of the plurality of backlight sections.

In one example of a backlight controller, the sensor input interface toreceive the user display context includes an application programminginterface (API) to receive context display data from one or moresoftware routines.

In one example of a backlight controller, the sensor input interface toreceive the user display context includes an application binaryinterface to decode the context display from one or more sensor signals.

In one example of a backlight controller, the user display context isbased on eye tracking data.

In one example of a backlight controller, the user display context isbased on ambient light data.

In one example of a backlight controller, the user display context isbased on motion sensing data.

In one example of a backlight controller, the user display context isbased on a cursor location in the display space.

In one example of a backlight controller, the user display context isbased on an image content.

In one example of a backlight controller, the backlight driver interfaceto encode the backlight control signal wherein the first set of one ormore of the plurality of backlight sections, corresponding to the focalpoint of the display space, output at the different light intensity thanthe second set of one or more of the plurality of backlight sectionduring a power save mode.

In one example of a backlight controller, the backlight driver interfaceto encode the backlight control signal wherein the first set of one ormore of the plurality of backlight sections, corresponding to the focalpoint of the display space, output at the same light intensity as thesecond set of one or more of the plurality of backlight section during anormal runtime mode.

In one example of a backlight controller, the user display context isbased on proximity data.

In one example of a backlight controller, the backlight driver interfaceto encode the backlight control signal wherein the first set of one ormore of the plurality of backlight sections, corresponding to the focalpoint of the display space, output at the different light intensity thanthe second set of one or more of the plurality of backlight section whenthe proximity data is in a first range.

In one example of a backlight controller, the backlight driver interfaceto encode the backlight control signal wherein the first set of one ormore of the plurality of backlight sections, corresponding to the focalpoint of the display space, output at the same light intensity as thesecond set of one or more of the plurality of backlight section when theproximity data is in a second range.

In one example there is provided, a backlight controller comprising: asensor input interface to receive one or more sensor input signals; afocal point module to determine a focal point of a display space fromthe one or more sensor input signals; and a backlight driver interfaceto encode a backlight control signal wherein a first set of one or moreof the plurality of backlight sections, corresponding to the focal pointof the display space, output at a different light intensity than asecond set of one or more of the plurality of backlight sections.

In one example of a backlight controller, the focal point of the displayspace is determined as a function of one or more eye tracking sensorsignals.

In one example of a backlight controller, the focal point of the displayspace is determined as a function of a light sensor signal.

In one example of a backlight controller, the focal point of the displayspace is determined as a function of one or more image sensor signals.

In one example of a backlight controller, the focal point of the displayspace is determined as a function of one or more motion sensor signal.

In one example of a backlight controller, the focal point of the displayspace is determined as a function of frame buffer signals.

In one example of a backlight controller, the focal point of the displayspace is determined as a function of one or more cursor locationsignals.

In one example of a backlight controller, the focal point of the displayspace is determined as a function of one or more proximity signals.

In one example of a backlight controller, wherein the backlight driverAPI to encode the backlight control signal wherein the first set of oneor more of the plurality of backlight sections, corresponding to thefocal point of the display space, output at the different lightintensity than the second set of one or more of the plurality ofbacklight section when the proximity data is in a first range.

In one example of a backlight controller, the backlight driver API toencode the backlight control signal wherein the first set of one or moreof the plurality of backlight sections, corresponding to the focal pointof the display space, output at the same light intensity as the secondset of one or more of the plurality of backlight section when theproximity data is in a second range.

In one example of a backlight controller, the backlight driver API toencode the backlight control signal wherein the first set of one or moreof the plurality of backlight sections, corresponding to the focal pointof the display space, output at the different light intensity than thesecond set of one or more of the plurality of backlight section during apower save mode.

In one example of a backlight controller, the backlight driver API toencode the backlight control signal wherein the first set of one or moreof the plurality of backlight sections, corresponding to the focal pointof the display space, output at the same light intensity as the secondset of one or more of the plurality of backlight section during a normalruntime mode.

In one example, there is provided a method of controlling illuminationof a monitor comprising: determining a focal point of a display spacebased on a user display context; driving a first set of one or more of aplurality of backlight sections corresponding to the determined focalpoint of the display space to output at a first intensity level; anddriving a second set of one or more of the plurality of backlightsections at a second intensity level.

In one example of a method of controlling illumination of a monitor, thefirst intensity level is increased above a predetermined intensitylevel; and the second intensity level is the predetermined intensitylevel.

In one example of a method of controlling illumination of a monitor, thefirst intensity level is a predetermined intensity level; and the secondintensity level decreased below the predetermined intensity level.

In one example, a method of controlling illumination of a monitorfurther comprises: driving the first set of one or more of the pluralityof backlight sections corresponding to the determined focal point of thedisplay space to output at the first intensity level during a power savemode; and driving the second set of one or more of the plurality ofbacklight sections at the second intensity level during the power savemode.

In one example, a method of controlling illumination of a monitor,further comprises driving the plurality of backlight sections at thefirst intensity level during a normal runtime mode.

In one example there is provided, a monitor management systemcomprising: an array of display elements; a backlight, disposedproximate a first side of the array of display elements, including aplurality of backlight sections; one or more sensors to determine a userdisplay context; and a backlight controller to control the lightintensity output by each of a plurality of backlight sections based onthe user display context, wherein a first subset of the plurality ofbacklight sections output at a first light intensity and a second subsetof the plurality of backlight sections output at a second lightintensity.

In one example there is provided, a monitor management systemcomprising: an array of display elements; a backlight, disposedproximate a first side of the array of display elements, including aplurality of backlight sections; one or more sensors to determine a userdisplay context; a backlight controller to control the light intensityoutput by each of a plurality of backlight sections based on the userdisplay context, wherein a first subset of the plurality of backlightsections output at a first light intensity and a second subset of theplurality of backlight sections output at a second light intensity.

In one example of a monitor management system, the one or more sensorsto determine a user display context includes an application programminginterface (API) to receive context display data from one or moresoftware routines.

In one example of a monitor management system, the one or more sensorsto determine a user display context includes an application binaryinterface to decode the context display from one or more sensor signals.

In one example of a monitor management system, the user display contextis based on eye tracking data.

In one example of a monitor management system, the user display contextis based on motion sensing data.

In one example of a monitor management system, the user display contextis based on a cursor location in the display space.

In one example of a monitor management system, the user display contextis based on an image content.

In one example of a monitor management system, the backlight controllerfurther comprises a backlight driver interface to encode the backlightcontrol signal wherein the first set of one or more of the plurality ofbacklight sections, corresponding to the focal point of the displayspace, output at a different light intensity than the second set of oneor more of the plurality of backlight section during a power save mode.

In one example of a monitor management system, the backlight controllerof further comprises a backlight driver interface to encode thebacklight control signal wherein the first set of one or more of theplurality of backlight sections, corresponding to the focal point of thedisplay space, output at the same light intensity as the second set ofone or more of the plurality of backlight section during a normalruntime mode.

In one example of a monitor management system, the user display contextis based on proximity data.

In one example of a monitor management system, the backlight driverinterface to encode the backlight control signal wherein the first setof one or more of the plurality of backlight sections, corresponding tothe focal point of the display space, output at the different lightintensity than the second set of one or more of the plurality ofbacklight section when the proximity data is in a first range.

In one example of a monitor management system, the backlight driverinterface to encode the backlight control signal wherein the first setof one or more of the plurality of backlight sections, corresponding tothe focal point of the display space, output at the same light intensityas the second set of one or more of the plurality of backlight sectionwhen the proximity data is in a second range.

While the forgoing examples are illustrative of the principles of thepresent technology in one or more particular applications, it will beapparent to those of ordinary skill in the art that numerousmodifications in form, usage and details of implementation can be madewithout the exercise of inventive faculty, and without departing fromthe principles and concepts of the technology.

What is claimed is:
 1. A backlight controller comprising: a sensor inputinterface to receive a user display context; a focal point module todetermine a focal point of a display space based on the user displaycontext; and a backlight driver interface to encode a backlight controlsignal, wherein said signal indicates that a first set of one or more ofa plurality of backlight sections, corresponding to the focal point ofthe display space, outputs at a different light intensity than a secondset of one or more of a plurality of backlight sections.
 2. Thebacklight controller of claim 1, wherein the sensor input interface toreceive the user display context includes an application programminginterface (API) to receive context display data from one or moresoftware routines.
 3. The backlight controller of claim 1, wherein thesensor input interface to receive the user display context includes anapplication binary interface to decode context display data from one ormore sensor signals.
 4. The backlight controller of claim 1, wherein theuser display context is based on eye tracking data.
 5. The backlightcontroller of claim 1, wherein the user display context is based onambient light data.
 6. The backlight controller of claim 1, wherein theuser display context is based on motion sensing data.
 7. The backlightcontroller of claim 1, wherein the user display context is based on acursor location in the display space.
 8. The backlight controller ofclaim 1, wherein the user display context is based on an image content.9. The backlight controller of claim 1, wherein the backlight driverinterface to encode the backlight control signal wherein the first setof one or more of the plurality of backlight sections, corresponding tothe focal point of the display space, outputs at the different lightintensity than the second set of one or more of the plurality ofbacklight sections during a power save mode.
 10. The backlightcontroller of claim 1, wherein the backlight driver interface to encodethe backlight control signal wherein the first set of one or more of theplurality of backlight sections, corresponding to the focal point of thedisplay space, outputs at the same light intensity as the second set ofone or more of the plurality of backlight sections during a normalruntime mode.
 11. The backlight controller of claim 1, wherein the userdisplay context is based on proximity data.
 12. The backlight controllerof claim 11, wherein the backlight driver interface to encode thebacklight control signal wherein the first set of one or more of theplurality of backlight sections, corresponding to the focal point of thedisplay space, outputs at the different light intensity than the secondset of one or more of the plurality of backlight sections when theproximity data is in a first range.
 13. The backlight controller ofclaim 12, wherein the backlight driver interface to encode the backlightcontrol signal wherein the first set of one or more of the plurality ofbacklight sections, corresponding to the focal point of the displayspace, outputs at the same light intensity as the second set of one ormore of the plurality of backlight sections when the proximity data isin a second range.
 14. A backlight controller comprising: a sensor inputinterface to receive one or more sensor input signals; a focal pointmodule to determine a focal point of a display space from the one ormore sensor input signals; and a backlight driver interface to encode abacklight control signal, wherein said signal indicates that a first setof one or more of a plurality of backlight sections, corresponding tothe focal point of the display space, outputs at a different lightintensity than a second set of one or more of a plurality of backlightsections.
 15. The backlight controller of claim 14, wherein the focalpoint of the display space is determined as a function of one or moreeye tracking sensor signals.
 16. The backlight controller of claim 14,wherein the focal point of the display space is determined as a functionof a light sensor signal.
 17. The backlight controller of claim 14,wherein the focal point of the display space is determined as a functionof one or more image sensor signals.
 18. The backlight controller ofclaim 14, wherein the focal point of the display space is determined asa function of one or more motion sensor signal.
 19. The backlightcontroller of claim 14, wherein the focal point of the display space isdetermined as a function of frame buffer signals.
 20. The backlightcontroller of claim 14, wherein the focal point of the display space isdetermined as a function of one or more cursor location signals.
 21. Thebacklight controller of claim 14, wherein the focal point of the displayspace is determined as a function of one or more proximity signals. 22.The backlight controller of claim 21, wherein the backlight driver APIto encode the backlight control signal wherein the first set of one ormore of the plurality of backlight sections, corresponding to the focalpoint of the display space, outputs at the different light intensitythan the second set of one or more of the plurality of backlightsections when the proximity data is in a first range.
 23. The backlightcontroller of claim 22, wherein the backlight driver API to encode thebacklight control signal wherein the first set of one or more of theplurality of backlight sections, corresponding to the focal point of thedisplay space, outputs at the same light intensity as the second set ofone or more of the plurality of backlight sections when the proximitydata is in a second range.
 24. The backlight controller of claim 14,wherein the backlight driver API to encode the backlight control signalwherein the first set of one or more of the plurality of backlightsections, corresponding to the focal point of the display space, outputsat the different light intensity than the second set of one or more ofthe plurality of backlight sections during a power save mode.
 25. Thebacklight controller of claim 24, wherein the backlight driver API toencode the backlight control signal wherein the first set of one or moreof the plurality of backlight sections, corresponding to the focal pointof the display space, outputs at the same light intensity as the secondset of one or more of the plurality of backlight sections during anormal runtime mode.